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AMENDMENTS TO THE CLAIMS 
1. (Currently amended) A method of determining a motional state of a mobile 

robot, the method comprising: 

retrieving pixel data for images taken at intervals from a camera that is coupled to 

the mobile robot; 

comparmg pixel data for a first image to pixel data for a second image to generate 
a measure of a diflference between the two images, wherein comparing comprises: 

filtering the first image pixel data with a gradient magnitude filter, where 
the gradient magnitude filter computes at least a spatial gradient; 

comparing the gradient-magnitude filtered first image pixel data to a first 

threshold; 

generating a binary map of the first image pixel data at least parUy in 
response to the comparison of the gradient-magnitude filtered smoothed first 
image pixel data with the furst threshold; 

filtering the second image pixel data with the gradient magnitude fdter; 

comparing the gradient-magnitude filtered smoothed second image pixel 

data to a second threshold; 

generating a binary map.of the second image pixel data at least partly in 
response to the comparison of the gradient-magnitude filtered second image pbtel 
data to the second threshold; and 

comparing the bmaiy map of the first image pixel data to the binary map 
of the second image pfacel data to identify data for pixels that are different between 

the first image and the second image; 

_ t«-va1 Hfl^s tn count the number of pixel data identified 

as changed; 

comparing the count to a thurd predetermined threshold; I[aitd]] 
determining the motional state of the mohile robot at least partly in response to the 
coimt : and 

airtnmaticallv providing an indication to a n^er that an undesired stoppage of the 
mobile robpt has occurred if: 
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real time. 
3. 
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FUed August 15, 2003 

th. rr^^^nr.^} .tete f T^-th. mnWli. robot indicates that the moMlg rp\)ot is nqt 

in motion: and 

Tnnhil y mhot is in »''"^<^ tft he in motion. 

(Original) The method as defined in Claim l. wherein the method is perfonned in 

(Original) The method as defined in Claim 1, wherein the gradient magnitude 

filter further comprises a low-pass filter. 

4. (Original) The method as defined in Claim 3, wherein the low-pass ^Iter 

corresponds to a Gaussian filter. 

5. (OriglnaO The method as defined in Claim 3. wherein filtering the first image 

pixel data fiirttier comprises: 

filtering the first image pixel data in a first direction and in a second direction 
with a gradient filter that is characterized by the following convolution kernel. 
[.1 _4 _5 0 5 4 1] / 32, where results of filtering are separately maintained for the first 
direction and for the second direction; and 

combining the separately maintained data by computing a magnitude of the data. 
. 6. (Original) Hie method as defined in Claim 1. fiirther comprising low-pass 
filtering image pixel data prior to computing a gradient. 

7. (Original) The method as defined in Claim 6, wherein a low-pass filter is 
characterized by the foUowmg convolution kernel: [1 4 6 4 1]/ 16; and a gradient filter is 
characterized by the fi)llowuig convolution kernel: [-1011/2. 
g. (Canceled) 

9. (Originai) Tue meUiod as defined in Claim 1, fiirther comprismg: 

receiving an indication tiiat the mobile robot is mtended to be m motion in a first 

direction; 

detennining that the motional state of tiie mobUe robot is not in motion while 
receiving the indication tiiat the mobile robot is intended to be in motion; and 

changing a path of travel for the mobile robot at least partly in response to tiie 

determination. 
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10. (Original) The method as defined in Claim 1, fUrther comprising subsamplirig the 
pixel data such that fewer than aU the available pixels ftom the camera aie used. 

11. (Original) The method as defined in Claim 1, wherein the third ptedetermined 
threshold varies at least partly in response to a number of pixels used to compute the count. 

12. (Original) The method as defined in Claim 1. wherein the first threshold and the 
second threshold are adaptive to filtering by the gradient magrutude filter of the first image pixel 
data and the second im^e pixel data, respectively. 

13. (Original) Tlie method as defined in Claim 12. wherein the first threshold is 
selected to be about half the maximum value for the gradient magnitude computed for a pixel by 
the gradient magniUide filter after filtering of the first image pixel data, and where the second 
threshold is selected to be about half the maximum value for the gradient magnitude computed 
for a pixel by the gradient magnitude filter after filtering of the second image pixel data. 

14. (Original) The method as defined in Claim 1, wherein the comparison of the 
binary map of the first image pixel data to the binary map of the secomi unage pixel data 
comprises a sloppy exclusive^r (XOR) computation. 

15. (Original) Tlie method as defined in Claim 14. wherein the sloppy XOR is 
computed by comparing a pixel ftom the binary map of the first image pixel data with a location 
of (x.y) to a plurality of pixels in the binary map of the second image pixel data, wherein the 
plurality of pixels mcludes a pixel with a location of (x,y). 

16. (Original) The method as defined in Chiim 1. wherein the motional state is 
determmed only with observation of visual data. 

17. (Original) The method as defined in Claim 1. where the mobile robot is 
autonomous, and where the method is performed entirely withm the mobile robot. 

18. (Original) The method as defined in Claim 1, fiirther comprising: 
sending pixel data from the mobile robot to a remote computer; 
performing at least part of filtering operations in the remote computer; and 

receiving an indication of the motional state of the mobile robot fioin the remote 

compxiter. 
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19. (CurrenOy amended) A method of detennining a motional state of a mobUe 

robot, the method comprising: 

receiving pixel data for video images, where the video images are taken from a 

camera mounted to the mobile robot; 

processing the pixel data for the video images to identify amounts of spatial 

gradient >vitbia a video image; 

characterizing pixels of a video image into at least a first group and a second 
group, wherein the pixels of the first group correspond to a higher spatial gradient than 
the pixels of the second group; [[and]] 

using the characterization of the pixels to compare a fnrst video image to a second 
video image to detect the motional state of the mobile robot, wherein the motional state is 
selected from a set of possible motional states, the set comprising at least "in motion" and 
"nnt IP "'"tirni " motion:" and 

mobile robo t V»i<8 occurred if: 

^^^^^.1 fft.t.. of the mobi i - i»^i^^tes th^t thff mobile ro1?ot is not 

in Tt^ ption: and 

fh^. mnhile rohnt is intende d f« he in motion. 

20. (Original) Hie method as defined in Claim 19, wherein characterizing further 

comprises: 

arranging the pixels of a video image into a binary map such that a fkst logic st^ 

indicates association with the first group with the higher spatial gradient; and 
a second logic state indicates assocUtion with the second group. 

21 . (OrlginaD The method as defined in Claim 20, wherein using the characterization 

cominises: 

comparing a binary value for one pixel from the binary map of the first image to a 
group of binary values for a group of pixels in the second image; 

wherein the group of pixels in the second image includes a pixel in the same 
location as the one pfacel from the binary map of the first image. 
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22. (Original) The method as defined in Claim 21, where comparing the bi^ 

to the group of binary values fiirther comFises computmg a sloppy Exclusive-OR Csloppy 
XOR") operation between the bmary vahie and the group of binary values. 

23. (Original) The method as defined in Claim 19, further comprising: 

inspecting pixel data to evaluate whether enough useful spatial gradients exist for 
robust detection of the motional state; and 

inhibiting a motional state of '*not moving" at least pjally in response to a 
determination tiiat the detection of the motional state is not likely to be reliable. 

24. (Original) The method as defined in Claim 19. wherein the motional state is 
determined only by analysis of visual data observed by the camera. 

25. (Original) The method as defined in Claim 19. where the mobile robot is 
autonomous, and where the method is performed entirely within the mobile robot. 

26. (Original) The method as defined in Claim 19, firrther comprising: 
sending pixel data from the mobile robot to a remote computer; 

performing at least part of pixel characterizing operations in the remote computer; 

and 

rtceiving an indication of the motional state of the mobile robot fix)m the remote 
computer. 

27. (Currently amended) A method of controlling a behavior of a mobile robot 
based on a mismatch between an intended motional state and a perceived motional stat« in a 

mobile robot, the metiiod comprising: 

receiving an indication of the uitended motional state, where ti>e motional state is 
selected ftom file group including moving and hot moving; 

using visual data ftom a camera ti»at is coupled to the mobile robot to perceive the 
motional state of the mobile robot, where the perceived motional state of tiie mobile robot 
is selected fi^m the group including moving and not moving; 

comparing tiie intended motional state to the perceived motional stat« to detect 
whether a mismatch exists between the intended motional slate and die perceived 
motional state; and 
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aotom^ changing the behavior of the mobile robot at least partty in response 

to a detected mismatch i£. 

.1,. ;^t.nH.H n,ntio rol °t»t. nf the mobile robot tP(|iWteg ^ t^e WP^^ 

mhnt is mo ving: and 

^.^.u,.A n^ntional 5t-^- »f tK. ^nhile robot ifldifflte^ th^t the moWl? 

rnhnt 1 R not moving , 

28 (Original) The method as defined in Claim 27, wherein the intended motional 
state is moving, where changing the behavior comprises changing a navigated path, further 

comprising: , .* * 

instructing the mobile robot to travel in a direction approximately opposite to that 
previously requested for at least a distance sufficient to clear an obstruction; 

instructing the mobUe robot to yaw; and 
instructing the mobUe robot to resume travehng. 

29 (Original) m method as defined in Clahn 27. wherein the intended motional 
state is moving, and where changing the behavior comprises shutting off motors to conserve 
battery life. 

30 (OrigiK* The method KideSMd to Clato 27, wtaidn the moWl^ 
ccn-prises floor cleaBtag brushes, wherein etangu^ the behavior fcrther «,«prises shuttit* off 

cleaning brushes. 

31 (Original) The method as defined in Claun 27. wherein the mobile robot fiirfher 
comprises a vacuum cleaner, wherein changing the behavior further comprises shutting off the 

vacuum cleaner. 

32. (Original) TTie me&od as defined in Claim 27. wherein the intended motional 
state is moving, and where charigiiig the beha-.-icr comprL^es setdng an alert. 

33. (Canceled) 

34 (Original) The method as defined in Claim 27. wherein the mobUe robot uses 
simultaneous localization and mapping (SLAM) techniques for navigation, where the intended 
motional state is not moving, wherein changing the behavior comprises: 
resetting an estimate of pose (location and heading); and 
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disabling mppingfimctions for recognition of new landm^ 

achieved. 

35 (OrigiBd) The melhod as defined to Clata 27, »h«em *e mobile robot iBes 
,tauhan««s loealizadon and mapping (SLAM) teetaiqnes 6r navi|i«ion. »b«e *e intend«l 
„<^s«« is not movtog,,»herein edging behavior convi^^ a^ 

the motional state to moving, ^ . u - 

36 (OrlglMl) The method as defined in Claim 35. wherein cbangtag the bd«:v.or 

flrther comprish* resetting esdmate of pose, including location and headi^^^ 

37 (Origh^I) Tto method as defined in Claim 27, wherein the mobUe robot nses 
*n,.«.„eous locaUz^ion and mapping (SLAM) .echm,ues tor navigation, where the intended 
motional st.«> is not movtog. whereto changing the behavior comprises disabling mappmg 
«mc1ionsfbrrec.pdtionofnewlandma*snnBlpassageofaprede.cnnined.mo>mtof.m>e^ 

38 (OrWrnO) The mdhod a, defln«l to Claim 37. wherein changtog the behavior 
teto compristo, resetttog an esttaud. of pose, toctadtog location and heading. 

39 (OrighMO The method as defined to CWm 27. whereto fl» mobile robot nses 
^mutaneous locdiz«ion »d mapptog (SLAM) t«toi,»es for n^dgation. where the in.e»ied 
motional «at. la not movtog. wh«eto ehangtog behavior comprises disablmg mappng 
functions ftr ,«K,gm«ion of new Undm«ks m«il a predetermtoed mmtbcr of unmatched 

landmarks have been observed. ^ . u • 

40 (Original) The method as defined in Claim 39, wherein changing the behavior 
further comprising resetting an estunate of pose, including location «^ 

41. (Original) The method as defined in Claim 27, wherein the intended motional 
state is moving, where changing the behavior comprises: 

. . A^^^ir,^ fh«i the mobile robot has been knocked over; 
usmg tne muictiuw" ~ — 

and 

initiating procedures to restore the mobUe robot to an upright position, 

42. (Original) The method as defined in Claim 27, wherein the motional state is 
perceived using only the visual data from the camera. 

43. (Original) The method as defined in Claim 27, where the mobile robot is 
autonomous, and where the method is performed entirely within the mobile robot. 
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44. (Original) The method as defined in Claim 27, farther comprising: 
transferring visual data from the mobile robot to a remote computer; 

performing at least part of filtering operations in the remote computer, and 
transferring an indication of the perceived motional state of the mobUe robot from 
the remote computer. 

45. (Original) A method of controlling the motion of a self-navigating mobile robot, 

tiie method comprising: 

receiving an indication that the mobUe robot is intended to be travehng m a 

forward direction; 

determining from visual image data coUected from a video camera coupled to the 
mobile robot that the mobile robot has ceased traveling in a forward direction; 

discontinuing commands to propel the mobUe robot in the forward direction; 
commanding the mobUe robot to travel in a reverse direction for at least a 

predetermined distance; 

determining that the mobile robot has traveled in the reverse direction for at least 

about Ae predetermined distance; 

discontinuing commands to propel the mobile robot in the reverse direction; 
instructing the mobile robot to yaw by at least a first predetermined angle; and 
commanding the mobile robot to resume forward motion. 

46. (Origjnal) lUe method as defined in Claim 45, wherein the predetermined 

distance is about 0.2 meters. 

47 (Original) Hie method as defined in Claim 45, wherein the predetermmed 
distance conesponds to at least an amount sufficient to permit the mobile robot to distance itself 

J , .,^4.u^«^4' u-.iTv«m-rkcr infn the interfering 

from an interfering object and to yaw nreeiy arouriu au aAx» w.uxw ^^^^ — 

object. ^ . • J 

48. (Original) THe method as defined in Claim 45. wherein the first predetermmed 

angle is about 90 degrees. 

49. (Original) A method of detecting that a mobile robot has been kidnapped, the 

method comprising: 

. receiving an indication that the mobUe robot is not instructed to be moving; 
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receiving data for video images from a camera coupled to the mobile robot; 
comparing data from different video images to detennine whether or not the 

mobile robot is in motion; and 

determining that the mobile robot has been kidnapped v.hen the video images 

indicate that the mobile robot is in motion. 

50. (Currently amended) A circuit for a mobile robot that is configured to determine 
a motional state of the mobUe robot, the circuit comprising: 

a means for receiving pixel data for video images, >vhere the video images are 
taken fiom a camera mounted to the mobile robot; 

a means for processing the pixel data for the video images to identify amounts of 

spatial gradient within a video image; 

a means for characterizing pixels of a video image into at least a first group and a 
second group, wherein the pixels of the first group correspond to a higher spatial gradient 
than the pixels of the second group: and 

a means for using the characteri^tion of the pbcels to compare a first video image 
to a second video image to detect the motional state of the mobile robot, wherem the 
motional state is selected from a set of possible motional states, the set compnsmg at 

least 'in motion" and "not in ae^essS ^0^02^ 

, fn. „rt.m^ ^^ }r^ r-^Ain. an ind.Vation to « mpr that an Mudesir^d 

^^,.pp<. p>. nf the mobile -'^^* occurred if: 

.K. p,^tinn.l stale »f ^nWle lobo* ^^.a;.' ^-. the mobile robot is not 

in motion, and 

tWf. mt fhi}e ro^nt is iniende< < in motion. 
51 (Currently amended) A computer program embodied in a tangible medium for 
controUing a behavior of a mobUe robot based on a mismatch between an intended motional state 
and a perceived motional state, the computer program comprising: 

a module with instructions for receiving an indication of the intended motional 
state, where the motional state is selected fiom the group including moving and not 
moving; 
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a module with mstructions for using visual data from a cameia that is coupled to 
the mobile robot to perceive the motional stat« of the mobile robot, ^ere the p«^^^ 

motional state of the mobUe robot is selected from the group including moving and not 

movii^; v 
a module vvith instructions for comparing the intended motional state to the 

perceived motional state to detect whether a mismatch exists between the intended 

motional state and the perceived motional state; and 

a module vrith instructions for changing the behavior of the mobile robot at least 

partly in response to a detected mismatch ^vhrrrm the hfhavior is changed if: 

^^^.^ jr.ntinr^\ s^ -^- »f tl>^ i^^bile robot indicates that the mobile 

mhot is not moving: and 

^ntinn^l s*-^» »f rnnhile mbot indicates that the mobUe 

r»V^ moving. 

52. (Currently amended) A circuit for control of a self-navigating mobile robot, the 

circuit comprising: , u 

a circuit configured to receive an indication that the mobUe robot is intended to be 

. traveling in a forward direction; 

a circuit configured to determine from visual image data collected from a video 
camera coupled to the mobUe robot that the mobile robot has ceased traveling in a 
forward direction; 

a circuit configured to discontinue commands to propel the mobile robot in the 

forward directionjfi 

ti,. mnhile robot r-^^^" traveling in the forward dlTgctiQP, ar^ 
.V,. rnhot s«t>.nH^ to he tnrrHinp m the forward direction; 

a circuit configured to command ti« mobile robot to travel in a reverse direction 

for at least a predetermined distance; 

a circuit configured to determine that the mobile robot has traveled in the reverse 
direction for at least about tiie predetermined distance; 
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a circuit configured to discontinue conmumds to propel the mobile robot in the 

reverse direction; « a* 

a circuit configured to instruct the mobile robot to yaw by at least a first 

predetermined angle; and 

a circuit configured to command the mobile robot to resume forward motion. 

53 (Previously presented) The method as defined in Claim 19, wherein processing 
the pixel data fiirther comprises processing the pixel data to identify amounts of spatial gradient 
within the entire video image. 
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